IN THE CLAIMS : 



Please amend the claims as follows. No new matter is introduced. 

1 . (Currently Amended) A method for detecting one or more objects belonging to 
the same object class comprising the steps of: 

a) receiving a video sequence from a video camera comprised of a plurality of 
image frames; 

b) applying one or more classifiers to detect components of objects in an image 
frame in the video sequence , wherein the component classifiers include classifiers for 
detecting components at multiple scales : 

c) computing a confidence score based in part on the response from the one or 
more component detectors; 

d) repeating steps b) and c) to detect components of objects belonging to the same 
object class in additional images frames in the video sequence; and 

e) accumulating confidence scores from the component detectors to determine if 
an object is detected,! 

wherein said method is adapted for use with a moving video camera . 

2. (Original) The method of claim 1 wherein if accumulated confidence scores 
indicate high confidence of a presence of an object, the method further comprising the 
step of: 

identifying the detected components to be an object of a particular type. 

3. (Original) The method of claim 1 wherein the object class is a vehicle. 

4. (Original) The method of claim I further comprising the step of: 

if an object is detected, outpuiting a detection signal and object position. 

5. (Original) The method of claim 2 further comprising the steps of: 



testing geometry constraints on a spatial arrangement of detected components in 
an image; and 

applying whole-appearance classifiers an image patch that contains the detected 
components and which is aligned according to the position of the detected components. 

6. (Original) The method of claim 5 wherein the geometry constraints are derived 
from camera parameters. 

7. (Original) The method of claim 5 wherein the geometry constraints are derived 
from object size. 

8. (Original) The method of claim 5 wherein the geometry constraints are derived 
from a location of an object appearance in the image. 

9. (Original) The method of claim 5 wherein the whole appearance classifiers detect 
entire or partial object appearance, the entire or partial object appearance being aligned 
according to positioning of at least two components. 

10. (Canceled) The method of claim 1 wherein the component classifiers include 
classifiers for detecting components at multiple scales. 

1 1 . (Original) The method of claim 1 wherein component classifiers are defined by 
discriminant features and decision rules which are learned through boosted training. 

12. (Original) The method of claim 1 1 wherein the discriminant features include 
corners. 

13. (Original) The method of claim 1 1 wherein the discriminant features include 
horizontal edges. 

14. (Original) The method of claim 1 1 wherein the discriminant features include 
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vertical edges. 



15. (Original) The method of claim 1 1 wherein the discriminant features include 
horizontal stripes. 

1 6. (Original) The method of claim 1 1 wherein the discriminant features include 
vertical stripes. 

17. (Original) The method of claim 1 1 wherein the discriminant features include 
diagonal stripes. 

1 8. (Original) The method of claim 1 1 further comprising the step of: 
performing an online adaptation to adapt a classifier structure to an online pattern. 

19. (Original) The method of claim 1 8 wherein the step of performing an online 
adaptation further comprises the step of: 

applying a dynamic switching strategy to direct the detector to take appropriate 
weak classifiers as discriminants according to auxiliary information about the online 
pattern. 

20. (Original) The method of claim 2 wherein the one or more classifiers include 
overlapping component classifiers. 

21 . (Original) The method of claim 20 wherein the overlapping component classifiers 
comprises four corners representing a rear profile of a vehicle. 

22. (Original) The method of claim 20 wherein the overlapping component classifiers 
comprises four corners representing a frontal profile of a vehicle. 

23. (Original) The method of claim 20 wherein the overlapping component classifiers 
comprises four corners representing a side profile of a vehicle. 
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24. (Original) The method of claim 21 wherein one of the overlapping component 
classifiers detects the bottom left corner of a vehicle. 

25. (Original) The method of claim 21 wherein one of the overlapping component 
classifiers detects the bottom right corner of a vehicle. 

26. (Original) The method of claim 21 wherein one of the overlapping component 
classifiers detects the top left corner of a vehicle. 

27. (Original) The method of claim 21 wherein one of the overlapping component 
classifiers detects the top right corner of a vehicle. 

28. (Original) The method of claim 21 wherein positioning of the four corners of the 
rear profile for a vehicle differ for different classes of vehicles. 

29. (Original) The method of claim 28 wherein a class of vehicle includes sedans. 

30. (Original) The method of claim 28 wherein a class of vehicle includes sports 
utility vehicles. 

3 3 . (Original) The method of claim 28 wherein a class of vehicle includes vans. 

32; (Original) The method of claim 28 wherein a class of vehicle includes tractor 
trailers. 

33. (Original) The method of claim 28 wherein a class of vehicle includes trucks. 

34. (Original ) The method of claim 21 wherein a distance between any two corners of 
the vehicle is constrained. 
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35. (Original) The method of claim 34 wherein the constraint between any two 
corners of the vehicle is scaled based on a distance between the vehicle and a camera 
capturing the video sequence and camera parameters. 

36. (Original) The method of claim 35 wherein an image pyramid of multiple 
resolutions is used to detect objects of size 2*x, 4*x and so on with the classifier for the 
size x. 

37. (Original) The method of claim 1 wherein the accumulated confidence scores are 
inferred from confidence scores across multiple frames using a recursive filter. 

38. (Original) The method of claim 37 wherein when the accumulated confidence 
score is a linear combination of the confidence scores of multiple component classifiers 
and the whole-appearance classifiers. 

39. (Original) The method of claim 38 wherein when the confidence score for a 
principal component classifier is sufficiently high, the confidence score of the remaining 
component classifiers and the whole-appearance classifier are computed. 

40. (Original) The method of claim 2 wherein if an object is detected the method 
comprising the step of: tracking the object over subsequent image frames. 

4 1 . (Original) The method of claim 40 wherein the step of tracking the object further 
comprises the step of: 

restricting an area of search in each subsequent image frame based on the location 
of the object in a current image frame. 

42. (Original) The method of claim 40 wherein the step of tracking the object further 
comprises the step of: 

determining the optimal classifier scale based on a distance between the object 
and a camera detecting the object and camera parameters. 
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43. (Original) The method of claim 1 wherein the confidence scores of component 
classifiers are computed in a coarse to fine framework. 

44. (Original) The method of claim 1 wherein detection is performed on an image 
pyramid of multiple resolutions. 

45. (Original) The method of claim 1 wherein an object class includes pedestrians. 

46. (Original) The method of claim 1 wherein an object class includes bicycles. 

47. (Original) The method of claim 1 wherein an object class includes motorcycles. 

48. (Original) The method of claim 1 wherein object class includes different types of 
traffic signs. 

49. (Currently Amended) A system for detection and tracking an object comprising: 

a camera for capturing a video sequence comprised of a plurality of image frames; 

a processor for receiving the video sequence and analyzing each image frame to 
determine if an object is detected, said processor applying one or more classifiers to 
detect components of objects in each image frame and computing a confidence score 
based on the response from the one or more component detectors and the result of 
additional validation , wherein the accumulated confidence scores is inferred from 
confidence scores across multiple fram es y jj _ ^ c ursive filter ; and 

a database for storing the one or more classifiers and object training samples^ 

wherein said system is adapted for use with a moving camera . 

50. (Original) The method of claim 49 wherein the object class is a vehicle. 

51. (Original) The method of claim 49 wherein the object class is a pedestrian. 
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52. (Original) The method of claim 49 wherein the object class is a bicycle. 

53. (Original) The method of claim 49 wherein the object class is a motorbike. 

54. (Original) The method of claim 49 wherein the object class includes different 
types of traffic signs. 

55. (Original) The system of claim 49 wherein the detected components are 
determined to be an object if the confidence scores are high. 

56. (Original) The system of claim 55 wherein if an object is detected, the processor 
outputs a warning signal. 

57. - (Original) The system of claim 49 further comprising: a display for displaying the 
video sequence. 

58. (Original) The system of claim 49 wherein the processor further comprises: 
means for testing geometry constraints on a spatial arrangement of detected 

components in an image; and 

means for applying whole-appearance classifiers an image patch that contains the 
detected components and which is aligned according to the position of the delected 
components. 

59. (Original) The system of claim 58 wherein the geometry constraints are derived 
from camera parameters. 

60. (Original ) The system of claim 58 wherein the geometry constraints are derived 
from object size, 

61 . (Original) The system of claim 58 wherein the geometry constraints are derived 
from a location of an object appearance in the image. 
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62. (Original) The system of claim 58 wherein the whole appearance classifiers detect 
entire or partial object appearance, the entire or partial object appearance being aligned 
according to positioning of at least two components. 

63. (Original) The system of claim 49 wherein the component classifiers include 
classifiers for detecting components at multiple scales. 

64. (Original) The system of claim 49 wherein component classifiers are defined by 
discriminant features and decision rules which are learned through boosted training. 

65. (Original) The system of claim 64 wherein the discriminant features include 
corners. 



66. (Original) The system of claim 64 wherein the discriminant features include 
horizontal edges. 

67. (Original) The system of claim 64 wherein the discriminant features include 
vertical, edges. 

68. (Original) The system of claim 64 wherein the discriminant features include 
horizontal stripes. 

69. (Original ) The system of claim 64 wherein the discriminant features include 
vertical stripes. 

70. (Original) The system of claim 64 wherein the discriminant features include 
diagonal stripes. 

7 1 . (Original) The system of claim 64 further comprising the step of: 
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performing an online adaptation to adapt a classifier structure to an online pattern. 

72. (Original) The system of claim 71 wherein the step of performing an online 
adaptation further comprises the step of: 

applying a dynamic switching strategy to direct the detector to take appropriate 
weak classifiers as discriminants according to auxiliary information about the online 
pattern. 

73. (Original) The system of claim 49 wherein the one or more classifiers include 
overlapping component classifiers. 

74. (Original) The system of claim 73 wherein the overlapping component classifiers 
comprises four corners representing a rear profile of a vehicle. 

75. (Original) The system of claim 74 wherein one of the overlapping component 
classifiers detects the bottom left corner of a vehicle. 

76. (Original) The system of claim 74 wherein one of the overlapping component 
classifiers detects the bottom right corner of a vehicle. 

77. (Original) The system of claim 74 wherein one of the overlapping component 
classifiers detects the top left comer of a vehicle. 

78. (Original) The system of claim 74 wherein one of the overlapping component 
classifiers detects the top right corner of a vehicle. 

79. (Original) The system of claim 74 wherein positioning of the four comers of the 
rear profile for a vehicle differ for different classes of vehicles. 

80. (Original) The system of claim 79 wherein a class of vehicle includes sedans. 
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8 1 . (Original) The system of claim 79 wherein a class of vehicle includes sports 
utility vehicles. 

82. (Original) The system of claim 79 wherein a class of vehicle includes vans. 

83. (Original) The system of claim 79 wherein a class of vehicle includes tractor 
trailers. 

84. (Original) The system of claim 74 wherein a distance between any two corners of 
the vehicle is constrained. 

85. (Original) The system of claim 84 wherein the constraint between any two corners 
of the vehicle is scaled based on a distance between the vehicle and a camera capturing 
the video sequence as well as camera parameters. 

86. (Original) The system of claim 85 wherein an image pyramid of multiple 
resolutions is used to detect objects of size 2*x, 4*x and so on with the classifier for the 
size x. 

87. (Canceled) The system of claim 49 wherein the accumulated confidence s cores- is 
inferred from confidence scores across multiple frames using a recursive filter? 

88. (Currently Amended) The system of claim 49 87 wherein when the accumulated 
confidence score is a linear combination of the confidence scores of multiple component 
classifiers and the whole- appearance classifiers. 

89. (Currently Amended) The system of claim 49 87- wherein when the confidence 
score for a principal component classifier is sufficiently high, the confidence score of the 
remaining component classifiers and the whole-appearance classifier are computed. 

90. (Original) The system of claim 49 wherein the processor comprises: 
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means for tracking a detected object over subsequent image frames. 

9 1 . (Original) The system of claim 90 wherein tracking means further comprises: 
means for restricting an area of search in each subsequent image frame based on 

the location of the object in a current image frame. 

92. (Original) The system of claim 90 wherein the tracking means further comprises: 
means for determining the optimal classifier scale based on a distance between the 

object and a camera detecting the object and camera parameters. 

93. (Original) The system of claim 49 wherein the confidence scores of component 
classifiers are computed in a coarse to fine framework 

94. (Original) The system of claim 49 wherein detection and tracking is performed on 
an image pyramid of multiple resolutions. 

95-104. (Canceled) 

105. (New) A method for detecting one or more objects belonging to the same object 
class comprising the steps of: 

a) receiving a video sequence from a video camera comprised of a plurality of 
image frames; 

b) applying one or more classifiers to detect components of objects in an image 
frame in the video sequence, wherein the one or more classifiers include overlapping 
component classifiers; 

c) computing a confidence score based in part on the response from the one or 
more component defectors: 

d) repeating steps b) and c) to detect components of objects belonging to the same 
object class in additional images frames in the video sequence; and 

e) accumulating confidence scores from the component detectors to determine if 
an object is detected^ 
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wherein said method is adapted for use with a moving video camera. 
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